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ABSTRACT 



An image taking apparatus includes an image taking sensor 
10 having a high- resolution mode and a normal mode; 
synchronous signal generators 7 and 8 for generating syn- 
chronous signals corresponding to die high-resolution mode 
and the ordinary mode, respectively; a first memory 17 for 
storing image signals taken in the high-resolution mode; a 
second memory 35 for storing image signals taken in the 
normal mode; and a video signal encoder 33 for processing 
the image signals stored in the second memory 35 in 
accordance with a predetermined image signal system, 
wherein, in the high-resolution mode, image signals are 
stored in the first memory 17 to output digital image signals, 
and, in the normal mode, image signals are stored in the 
second memory 35, video signals 34 being output from the 
encoder 33. 

8 Claims, 18 Drawing Sheets 
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IMAGE SENSING APPARATUS WITH 
OPTICAL-AXIS DEFLECTING DEVICE 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to an image taking 
apparatus, such as a video camera, thai is equipped with an 
image taking device, such as a chargc-couplcd devic e 
hereinafter referred to as "Cm "'! . 

2. Description of the Related Art 

Conventional image taking apparatuses equipped with an 
image taking device, such as CCD, are used as a means for 
supplying information to a video monitor, a VTR (video tape 
recorder), etc. In such an image taking apparatus, a video 
signal (NTSC, PAL signal, etc.) is obtained by driving the 
image taking device in accordance with the frequency of the 
video signal. The number of pixels in one frame, that is, the 
number of effective pixels of the image taking device, is 
determined by the number of lines, frequency 
characteristics, etc. of the video signal. Thus, it is possible 
to check the taken image in real time by means of a video 
monitor or the like. 

Recently, however, image taking devices which provide a 
still higher level of resolution than obtainable with video 
signals have been developed. In image taking apparatuses 
using such a high-resolution image taking device, it is 
possible to take images at high resolution due to the large 
number of pixels, - 

However, conventional image taking apparatuses using 
such a high-resolution image taking device, in which it is 
possible to take images at high resolution due to the large 
number of pixels, require, on the other hand, a monitor, 
printer, etc. adapted to high resolution. Thus, the taken 
image cannot be easily checked by a video monitor or the 
like as in the prior art. 

SUMMARY OF THE INVENTION 

The present invention has been made with a view toward 
solving the above problem in the prior art. It is an object of 
the present invention to provide an image taking apparatus 
which is capable of taking images at high resolution and 
which allows a standard image video signal to be output to 
a video monitor or the like and monitored. 

To achieve this object, in accordance with an embodiment 
of the present invention, there is provided an image taking 
apparatus comprising: an image taking device for effecting 
photoelectric conversion of images; synchronous signal gen- 
erating means for generating a synchronous signal for oper- 
ating the image taking device in correspondence with each 
of a high-resolution mode and a normal mode; storage 
means for storing image signals obtained by processing the 
output from the image taking device; image signal output 
means for outputting the image signals stored in the storage 
means after processing them in accordance with a predeter- 
mined image signal system; and control means for selecting 
either the high-resolution mode or the normal mode to 
perform image taking, the number of pixels of the image 
taking device being large enough to enable images to be 
taken at high resolution, the control means supplying the 
synchronous signal from the synchronous signal generating 
means to the image taking device in correspondence with 
either the high-resolution mode or the normal mode to 
perform image taking, wherein, in the high- resolution mode, 
the image signals are stored in the storage means and digital 
image signals, and wherein, in the normal mode, the image 
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signals are stored in the storage means and video signals are 
output from the image signal output means. 

Due to the above construction, the image taking device, 
having a number of pixels which is large enough to enable 
S image taking to be performed at high resolution, can take 
images in either the high-resolution mode or the nonnal 
mode in accordance with the synchronous signal output 
from the synchronous signal generating means and corre- 
sponding to the selected mode, and, in both modes, the 
image signals, obtained by processing the output from the 
image taking device, are stored in the storage means. 

In the high-resolution mode, digital image signals having 
a high level of resolution are output. In the normal mode, 
video image signals processed in accordance with a prede- 
termined image signal system are output by the image signal 
output means. 

As described above, either the high-resolution mode or 
the normal mode can be selected for image taking, and 
image signals for image display according to the selected 

20 mode can be output. Further, in both modes, the taken 
images are recorded or stored, and, by reading these images 
and subjecting them to the requisite image signal processing, 
it is possible to check the images on a monitor. 

In accordance with another embodiment of the present 

25 invention, there is provided an image taking apparatus 
comprising: an image taking sensor having at least first and 
second image taking modes and adapted to operate in two or 
more image taking modes; first signal processing means for 
effecting a predetermined signal processing on image signals 

30 output from the image taking sensor; storage means for 
storing the image signals output from the image taking 
sensor; second signal processing means for effecting a 
predetermined signal processing on the image signals stored 
in the storage means; and control means which, in the first 

35 image taking mode, causes the image signals supphed from 
the image taking sensor to be processed by the first signal 
processing means and which, in the second image taking 
mode, causes the image signals stored in the storage means 
to be processed by the second signal processing means. 

40 In stiU another aspect of the present invention, there is 
provided an image taking apparatus comprising: an optical 
lens; an image taking sensor having at least first and second 
image taking modes and adapted to operate in two or more 
image taking modes; first image processing means for 

45 processing image signals taken by the image taking sensor; 
an A/D converter for A/D -converting the image signals 
taken by the image taking sensor; storage means for storing 
the image signals converted into digital signals by the A/D 
converter; second signal processing means for processing 

50 the digital image signals stored in the storage means; mode 
switching means for switching the mode for processing the 
image signals taken by the image taking sensor between the 
first and second image taking modes; and control means, 
which, when the first image taking mode is selected by the 

55 mode switching means, causes signal processing to be 
performed by the first signal processing means, and which, 
when the second image taking mode is selected by the mode 
switching means, causes signal processing to be performed 
by the second signal processing means. 

60 In a still further aspect of the present invention, the image 
taking sensor simultaneously reads image taking data in an 
amount corresponding to two vertically adjacent lines, out- 
putting a signal obtained by adding image signals corre- 
sponding to two vertically adjacent pixels when in the first 

65 image taking mode, ajnd, when in the second image taking 
jpnde mitpyL'; a sipnal For each pixel, without performing 
additigp of image daia. 
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In a still further aspect of the present invention, the image not only can the normal signal processing be conducted and 

taking sensor is an image taking sensor using a complemen- the results thereof displayed on the monitor, but also the 

tary color mosaic filter. output of each of the pixels of the image taking sensor is 

In a still further aspect of the present invention, the image extracted to perform another kind of signal processing, such 
taking sensor is a CCD image taking device. s as resolution enhancement. 

In a still further aspect of the present invention, there is f^^her, by arranging the optical axis moving means 

provided an image taking apparatus comprising: an opUcal <iirectly before the miage taking sensor, it is possible to 

lens; optical-axis moving means for moving the optical axis perform image taking with pixel shift. Further, by executing 

of a light entering through the optical lens; optical-axis signal processing for pixel shift on the image signab 

movement control means for controlling the operation of the obtained by the image taking, it is possible to perforaa image 

optical-axis moving means; an image taking sensor having taking at high resolution. 

at least first and second image taking modes and adapted to Further, it is possible to separate the camera head from the 

operate in two or more image taking modes; first image signal processing section, and the camera head is 

processing means for performing a predetermined signal replaceable, whereby combination of an ordinary image 
processing on image signals taken by the image taking ""^ taking camera, a camera adapted to pixel shift, etc. can be 

sensor; an A/D converter for A/D-converting the image easily effected. 

signals taken by the image taking sensor; storage means for In still another aspect of the present invention, there is 

storing the image signals converted into digital signals by provided an image taking apparatus comprising: an image 

the A/D converter; second signal processing means for taking device having a predetermined number of pixels and 

performing a predetermined signal processing on the digital adapted to effect photoelectric conversion on images formed 

image signals stored in the storage means; and control by an optical lens; an A/D converter for effecting A/D 

means, which, in the first image taking mode, causes the conversion on image signals taken by the image taking 

predetermined signal processing to be performed by the first device; a memory for storing image data obtained by the 

signal processing means, and which, in the second image A/D conversioQ ; a firs t colo r processing section tor ettectiilg 

taking mode, causes image taking to be performed a plural- color conversion'orn i]^- Iffla^e riata ^itfife^ m tne memory ; a 

ity of times while causing the optical-axis moving means to f^r^t gynn hrnn ^-||f^ ^l ^^^ generator for e ; enerating a svnchr o- 

be controlled by the optical- axis movement control means, nous signal for controlling the image tatcm^ device, the A /0 
storirig the thereby obtained image signals in the storage _ conycrtcr. the nie^^^ 

means, and, at the same time, causes the predetermined a second synnhrnnmis signal ^eneratof foj fr ^ per ^jiy g a 

signal processiag to be performed by the second signal synchronous signal having a frequency different from that ^ f 

processing means. the svnchronous signal generated by the first synchronm ts 

In a still further aspect of the present invention, the image signal generator: and a second color processing sectioji 

taking sensor simultaneously reads image taking signals which reads the inaap data stored m tne memory witn the 
corresponding to two vertically adjacent lines, outputting a ^5 synchronous signal generated by the second synchronous 

signal obtained by adding image signals corresponding to signal generator and performs color conversion on the imag e 

two vertically adjacent pixels when in the first image taking d.^^- 

mode, and, when in the second image taking mode, outputs The image taking device is driven by the synchronous 

asignalforeachpixel, without performing addition of image signal of the first synchronous signal generator, and the 

signals. image signal thereby obtained is A/D -converted and tem- 

In a still further aspect of the present invention, the image porarily stored in the memory. The image signal thus stored 

taking sensor is an image taking sensor using a complemen- is read by means of the gy prhrnnnn^ siicmai at the first 

tary color mosaic filter. s.yncM^nnn^^s si^nai treneTator and color-converted hv the 

In a stm further aspect of the present invention, the image fi?tCfiJnr PfftggSW ^ion . Further, the memory is read 

taking sensor is a CCD image taking device. wi^h thfl ^vnrhnwtl l ^ ^i^nfil ot \m fig9ond^ gmchr^s 
^ , ^ , , . , » sig nal generato r. Thus, even in the case of an image taking 

In a suU ftirther aspect of the present invenUon, the havinia large number of pixels and providing a high 

optical-axis movmg means is a vanable-apex- angle pnsm. ^^^^j resolution, it is possible to check the taken unage 

In a still further aspect of the present invention, the immediately after the image taking by means of the image 

optical-axis moving means is a lens shift, signal which has been color-converted by the second color 

In a stiU further aspect of the present invention, the processing section, 

optical-axis moving means consists of a plane-parallel-plate other objects and features of the present invention will 

rotating system. become apparent from the following detailed description 

In a still further aspect of the present invention, there is and the drawings, 

provided an image taking apparatus according to claims 1 55 BRIEF DESCRIPTION OF THE DRAWINGS 
through U, wherein an image taking umt including an 

optical lens and an image taking sensor is separated from a PIG. 1 is a block diagram showing a first embodiment of 

signal processing unit which receives signals from the image present invention; 

taking unit and performs signal processing on the signals, FIG. 2 illustrates a filter arrangement in an image taking 

with the two units being capable ofbeing connected together sensor; 

through a cable, FIG. 3 is a block diagram showing a second embodiment 

In the image taking apparatus of the present invention, of the present invention; 

comprised of the technical means described above, the FIG. 4 is a block diagram showing a third embodiment of 

image taking sensor can be operated in either of the first and the present invention; 

secnnH in- ^flfre takinp ^ mndes, and, at the 5same time, the si^nfll 65 FIG. 5 is a block diagram showing an image taking 

processing at the subsequent stage is conducted in accor- apparatus according to a fourth embodiment of the present 

dance with either of the two image taking modes, whereby invention; 
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FIG. 6 is a diagram showing an example of a 
complementary-color-mosaic-filter anangement in a single- 
plate image taking sensor; 

FIG. 7 is a flowchart illiislrating the operation of the 
fourth embodiment; 

FIG. 8 is a block diagram showing an image taking 
apparatus according to a fifth embodiment of the present 
invention; 

FIG. 9 illustrates a optical axis movement by a plane - 
parallel plate; 

FIG. 10 shows an example of an image taking with pixel 
shift; 

FIG. 11 is a flowchart illustrating the operation of the fifth 
embodiment; 

FIG. 12 is a block diagram showing an image taking 
apparatus according to a sixth embodiment of the present 
invention; 

FIG. 13 is a block diagram showing the construction of a 
first camera head section; 

FIG. 14 is a block diagram showing the construction of a 
second camera head section; 

FIG. 15 is a block diagram showing the construction of a 
camera signal processing section; 

FIG. 16 is a block diagram showing a seventh embodi- 
ment of the present invention; 

FIG. 17 illustrates the construction of a first memory and 
" that of a first memory controller in detail; ~ 

FIG. 18 is a block diagram showing an eighth embodi- 
ment of the present invention; and 

FIG. 19 is a block diagram showing a ninth embodiment 
of the present invention. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENfTS 

The image taking apparatus of the present invention will 
now be described with reference to specific embodiments. 
(First Embodiment) 

FIG. 1 is a block diagram showing the first embodiment 
of the present invention. 

In FIG. 1, numeral 1 indicates a lens; numeral 2 indicates 
an apermre; numeral 7 indicates a first synchronous signal 
generator; numeral 8 indicates a second synchronous signal 
generator adapted to operate at video rate; numeral 9 indi- 
cates a switch for switching between the synchronous sig- 
nals; numeral 10 indicates an image taking sensor; numeral 
12 indicates a timing generator for generating timing pulses 
for operating the image taking sensor 10; numeral 13 
indicates an SH^GC circuit for performing sample-and- 
hold on the output of the image taking sensor 12 to effect 
AGC (automatic gain control); numeral 14 indicates an A/D 
converter; numeral 15 indicates a switch for switching the 
output of the A/D converter 14; numeral 17 indicates a^rst 
color processing nfirtinn f'^r ^nndli cting color processing; 
numeral indicates a first memory for storing color- 
converted luminance two-cninr difference mJVl data: 
numeral 19 indicates a first memory conlroUer for control- 
ling the first memory 18; numeral 20 indicates a compressor/ 
expander for compressing/expanding luminance two-color 
difference (YUV) data; numeral 21 indicates an interface; 
numeral 22 indicates a storage device; numeral 3 1 indicjttes 

a^ second mlnr pmcessinp sertinn fnr perfnrminp color 

*processing; numeral 32 indicates a D/A converter; numeral 
"33 indicates a video signal encoder; numeral 34 indicates a 
video output signal; numeral 35 indicates a second memory 
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for storing the luminance two-color (YUV) data color con- 
verted by the second color processing section 31; and 
numeral 36 indicates a second memory controller for con- 
trolling the second memory 35. 

5 The image taking sensor 10 is a solid-state image sensing 
device, such as CCD, and has a number of effective pixels 
of 1536x988, which is large enough to provide high reso- 
lution. This image taking sensor is a single -plate color 
Rep-cnr in which ;^ complementnrj rnlOT mmnir filtrr f^U 

10 ^l£Ois««fi£). is attached to a chip. FIG. 2 shows an example 
of the layout of the complementary color mosaic filter (Cy, 
Mg, Ye, Gr) attached to the chip. In the image taking sensor 
10, the switch 9 effects switching between synchronous 
signals having different frequencies that are respectively 

15 generated by the first and second synchronous signal gen- 
erators 7 and 8, thereby enabling the image taking sensor 10 
to operate in two image taking modes. 

The second image taking mod e will be explained first. 
The second synchronous signal generator 8 generates a 

20 synchronous signal for video signals (NTSC, PAL and the 
like). It effects thinning-out by reducing the apparent num- 
ber of pixels through addition of pixels of the same filter 
arranged close to each other, or by skipping over part of the 
pixels when reading them from the image taking sensor 10. 

25 Alternatively, it reads only a particular storage area. In this 
way, it has the same access to data in the same way as in the 
case of video CCD, and reads 768x494 pixels in accordance 
with a video signal. 

In accordance with the synchronous signal generated by 

30 the second synchronous signal generator 8, the timing gen- 
erator 12 generates driving pulses for the image taking 
sensor 10. The image signal taken by the image taking 
sensor 10 is subjected to s ample- and-hold and AGC 
(automatic gain control) for removing switching noise and 

35 extracting the signal component at the SH,AGC circuit 13, 
and converted to digital data by the 10-bit A/D converter 14. 
The image signal converted to digital data by the A/D 
converter 14 is transmitted through the switch 15, and is 
cnlnr-onn verted to luminance two-color difference fYUVO 

40 data by the second color processing section 3l. This lumi- 
nance two-color difference (YUV) data is stored in the 
second memory 35 under the control of the second memory 
controller 36. The luminance two-color difference (YUV) 
data, which is lemporarUy stored in the memory 35, is 

45 converted to an analog signal by the D/A converter 32, and 
modulated into a video signal by the encoder 33 to be output 
as the video signal 34 and displayed on a video monitor (not 
shown) or the like. 

Here, the luminance two-color difference (YUV) data 

50 color-converted by the second color processing section 31 is 
first stored in the second memory 35, and then read to be 
transmitted to the D/A converter 32. However, it is also 
possible to transmit the luminance two-color difference 
(YUV) data, color-converted by the second color processing 

55 section 31, directly to the D/A converter 32 and simulta- 
neously input it to the memory 35. 

Next, the first ima^e taking mode will be described, pie, 
first synchronous signal generator ^ 7 is a svnchr ^"^ii^ 
peneratnr tnr hitrh-resnlntmn imatre taking. In accnrdance 

60 with the synchronous signal generated by the first synchro- 
nous signal generator 7, the timing generator 12 generates 
driving pulses for the image taking sensor 10. Then, as in the 
second image taking mode, the imape signal taken by the 
ima^e taking sensor 10 is subjected to sa mple-and-hnid and 

65 AG& (automatic gain control) J br removing switching noise 
and extracting the signal component at the SH AGC circuit 
13, and converted to digital data by the 10-bit A/D converter 
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14. The image signal converted to digital data by the A/D 
converter 14 passes through the switch 15- and is colnrr 
converted to lutninance two-color difference (YUV) dataJ jv 
the first color processing section ij , ibis luminance two- 
. color difference (YUV) data is stor5 in the tirst memory 1ft 
under the control of the first memory controller 19. The 
luminance two-color difference (YUV) data, which is stored 
in the first memory 18, is compressed by the compressor/ 
expander 20 as needed, and transmitted to an external file or 
a computer (not shown) through the interface 21. 

It is also possible for the image signal converted to digital 
data by the A/D converter 14 to be transmitted to an external 
file or a computer (not shown) through the interface 21. 

Due to the above construction, it is possible to output 
image signals in accordance with a standard video system 
through selection of the second image taking mode. Further, 
by selecting the first image taking mode, it is possible to 
output a high-resolution image signal. In whichever mode, 
the image signals are stored in the memory. 
(Second Embodiment) 

FIG. 3 is a block diagram showing the second embodi- 
ment of the present invention. The components which are 
the same as or equivalent to those of the first embodiment 
are indicated by the same reference numerals and a descrip- 
tion of such components will be omitted. 

In FIG. 3, numeral 38 indicates a third memory for storing 
the output of the image taking sensor 10 as it is, and numeral 
39 indicates a third memory controller for controlling the 
third memory 38. - 

As in the first embodiment, the synchronous signal gen- 
erated by the first or second synchronous signal generator 7 
or 8 is switched by the switch 9 to drive the image taking 
sensor 10. The image signal taken by the image taking 
sensor 10 is subjected to sample -and-hold and AGC 
(automatic gain control) for removing switching noise and 
extracting the signal component at the SH,AGC circuit 13, 
and converted to digital data by the 10-bit A/D converter 14 
to be stored in a third memory 38. Here, the third memory 
38 has a capacity that is large enough to store both high- 
resolution image data (1536x988 pixels) read by the image 
taking sensor 10 in accordance with the first synchronous 
signal generator 7 and low-resolution image data (768x494 
pixels) read by the image taking sensor 10 in accordance 
with the second synchronous signal generator 8. 

In the second image taking mode, the second synchronous 
signal generator 8 is selected by the switch 9. When the 
image taking sensor 10 is taking images in accordance with 
the second synchronous signal generator 8, the A/D- 
converted image data is stored in the third memory 38, and, 
at the same time, transmitted to the second color processing 
section 31. Then, as in the first embodiment, it is color- 
converted to luminance two-color difference (YUV) data by 
the second color processing section 31, and the luminance 
two-color difference (YUV) data obtained by color conver- 
sion is converted to an analog signal by the D/A converter 
32, and modulated into a video signal by the encoder 33 
before it is output as the video signal 34 and displayed on a 
video monitor (not shown) or the like. 

Next, to be described will be the operation to be per- 
formed when the first image taking mode for high-resolution 
image taking is selected and the switch 9 selects the first 
synchronous signal generator 7. 

When the first synchronous signal generator 7 is selected, 
the image data, which has been read by the image taking 
sensor 10 in accordance with the second synchronous signal 
generator 8 and stored in the third memory 38, ceases to be 
treated in this way. The images that have been stored before 
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the switching are read in accordance with the second syn- 
chronous signal generator 8. The image sensor 10 is then 
driven in accordance with the first synchronous signal 
generator 7. The image signals taken by the image taking 

5 sensor 10 are subjected to sample- and-hold and AGC 
(automatic gain control) for removing switching noise and 
extracting the signal components at the SH,AGC circuit 13, 
and converted to digital data by the 10-bit A/D converter 14 
before it is stored in the third memory 38. The storage area 
used when storing the data in the third memory 38 is 
different firom the area used in the second image taking mode 
so that the image data that has been stored prior to the mode 
switching may not be zapped. 

When the image taking at high resolution has been 
completed, the high-resolution image data stored in the third 

1^ memory 38 is stored in the storage device file 22, or 
transmitted to a computer (not shown) through the interface 
21 to undergo color processing. At the same time, the image 
taking mode is restored to the second image taking mode, 
and the switch 9 is switched to the side of the second 

20 synchronous signal generator 8. The image taking sensor 10 
is operated in accordance with the second synchronous 
signal generator 8, and the video signal 34 is output while 
storing the data in the third memory 38. 

As described above, the second embodiment has a con- 

25 struction which is simplified as compared to that of the first 
embodiment, and it is possible to output video signals and 
high-resolution digital signals. It is also possible to signals 
of both types. 

— (Third Embodiment) _ 

30 FIG. 4 is a block diagram showing the third embodiment 
of the present invention. The components which are the 
same as or equivalent to those of the above-described 
embodiments are indicated by the same reference numerals. 
In FIG. 4, numeral 1 indicates a lens; numeral 2 indicates 

35 an aperture; numeral 4 indicates a system controller for 
overall control; numeral 5 indicates an operating panel; 
numeral 10 indicates an image taking sensor; numeral 8 
indicates a synchronous signal generator; muneral 12 indi- 
cates a timing generator for generating timing pulses for 

40 operating the image taking sensor 10; numeral 13 indicates 
an SH,AGC circuit for performing sample- and-hold on the 
output of the image taking sensor 12 to thereby effect AGC 
(automatic gain control); numeral 14 indicates an A/D 
converter; numeral 15 indicates a switch for switching the 

45 output of the A/D converter 14; numeral 41 indicates a 
fourth memory for storing noise components (noise 
memory); numeral 42 indicates a fourth memory controller 
for controlling the fourth memory (noise memory); numeral 
43 indicates a computing unit to which image signals are 

50 input from the image taking sensor 10 and which subtracts 
therefrom the noise components stored in the fourth tnemory 
(noise memory) 41 before outputting them; numeral 31 
indicates a second color processing section for performing 
color processing; numeral 32 indicates a D/A converter; 

55 numeral 33 indicates a video signal encoder; numeral 34 
indicates a video output signal; numeral 35 indicates a 
second memory for storing video data; and numeral 36 
indicates a second memory controller for controlling the 
second memory 35 for video. 

60 In FIG. 4, the image taking sensor 10 operates in accor- 
dance with the synchronous signal generated by the sole 
video synchronous signal generator 8. As in the first 
embodiment, the image signal output from the image taking 
sensor 10 is subjected to sample-and-hold and AGC 

65 (automatic gain control) for removing switching noise and 
extracting the signal component at the SH,AGC circuit 13, 
and converted to digital data by the 10-bit A/D converter 14. 
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The image signal converted to digital data by the A/D FIG. 5 is a block diagram showing an image taking 
converter 14 is directed to either the fourth memory 41 or the apparatus according to th e fourth embodiment of the present 
computing unit 43 by the switch (demultiplexer). Here, in a invention. In FIG. 5, numeral 101 indicates an optical lens; 
dark noise extraction mode, m which the apermre 2 is numeral 102 indicates an aperture; numeral 103 indicates a 

closed, the noise components from the image taking sensor 5 driver for the optical system; numeral lOfi indicates 
10 are stored in the fourth memory 41 as signals. When ^^^^^ ^^y^-^ p c>.tic^r| n u meral 107 indicates a synchronous 
image taking is conducted in the normal mode, the image s itmal generator rsLSGV numeral 108 indicates a system 
signal is input to the computing unit 43, and the difference controller for controlliiig the operation of the entire appa- 
between this input data and the noise data stored in the ^^^^.^^ 109 indicates an operating switch; numeral 

fourth memory 41 is output. . 10 112 indicates a timing generator (TG); numeral 113 indicates 

The image signal on which noise component a)rrection ^ sample -and-hold/AGC; numeral 114 indicates an A/D 
has been effected, is subjected to ^^^^^^^^^^^^^ converter; numeral 115 indicates a changeover switch (SW); 

color processmg section 31, and converted mto luminance o.. 1 • \- 

two-cilor difference (YUV) data by the color processing ^^J. ^^'^^^^^^ / f^* ^^g^^ processmg section; 

section 31. In this color processing section 31, data for auto ^^^^'^ mdicates a first memory; numeral 119 mdicates 

white balancing is extracted, and subjected to computation 15 a first memory control section; numeral 120 mdicates a D/A 
by the system controller 4 to perform gain setting for each converter; numeral 121 indicates a video encoder; numeral 
color, thereby setting white balance. SimUarly, data for 122 indicates a video signal; numeral 132 indicates a second 
automatic focusing and data for auto iris are extracted and memory; and numeral 133 indicates a second memory 
subjected to computation by the system controller 4 to control section. 

thereby adjust the lens and the aperture. 20 In FIG. 5, an optical image is formed on the image taking 
The image signal converted to luminance two-color dif - sensor 106 by a light entering through the optical lens 101 
ference fYUV) data by the color processi np s^.c!tin|^ ^1 Js and the aperture 102. The image taking sensor 106 may, for 
converted to an analo g signal by the D/A converter 32, an d example, be an area sensor having a color filter, a CCD 
ihe coloi' dlUerence signal is modulated into a chromatic sensor, or a M OS type sensor. It is also possible to use a 

signal indicative of saturation by the encoder 33 . Here, the 25 bipolar image sensor (BASIS) having a bipolar transistor for 
image signal converted to a luminance two-color difference each pixel. 

(YUV) signal by the color processing section 31 is displayed The entire system of the image taking sensor 106 is 
as a video signal, and, at the same time, stored in the second selectively sef to either the first or the -second image taking 
memory 35, mode through manual operation by using the operating 

In a dark noise extraction mode, in which the aperture 2 30 switch 109, and operates in either the first or the second 
is closed, video data taken in the normal image taking mode image taking mode through control by the system controller 
and stored in the second memory 35 is read and transmitted 108. The difference between 'the first and second image 
to the D/A converter 32 before it is output as a video signal. taking modes consists in a difference in the timing signal for 

As described above, this embodiment makes it possible to driving the image taking sensor 106 and a difference in the 

effectively output video signals. When appUed to the video 35 subsequent processing system. 

signal output section of the first and second embodiments. First, the operation in the first image taking mode will be 
this embodiment enables the present invention to be carried described. In the first image taking mode, the image taking 
out more effectively. sensor 106 is driven by a first timing signal generated by the 

In accordance with the above-described embodiments, it timing generator 112 in accordance with the synchronous 

is possible to take images in a high resolution mode and in 40 signal generated by the synchronous signal generator 107. 
a normal mode by an image taking device having a number the first i ma^e taking , mode, tb? imap^e (aking sensor 106 
of pixels which is large enough to enable image taking to be .nntpiifR ip iage data after performing addition of two verti- 
performed at high resolution. In both modes, the image callv adjacent pixels in the sensor, and is controlled by 
signals obtained by processing the output from the image driving p ulses gener ated bv the *''ni^^f! ^^neratf^r 112 

taking device are stored in the storage means. 45 Generally speaking, the timing pulse generator for driving 

In the high resolution mode, a digital image signal having the image taking sensor 106 generates timing pulses that are 
high resolution is output. In the normal mode, a video image specific to the associated image taking sensor, so that an IC 
signal processed according to a predetermined image signal adapted to each particular image taking sensor is provided, 
system is output by the image signal output means. In the first image taking mode, pixel addition of two 

As described above, it is possible to select either the high 50 vertically at^jacent pi xels is cond iicted in the imape taking 
resolution mode or the normal mode in performing image sensQr, and correlation double sampling and AGC 
taking and to output an image signal for image display in (automatic gain control) are performed, the resultant data 
accordance with the selected mode. Further, in both modes, being digitized by the A/D converter 114. 
the images taken are recorded or stored, and, by reading In the first image image taking mode, the image signal 

them and subjecting them to the requisite image taking 55 thus digitized is transmitted to the first signal processing 
processing, it is possible to check the images on a monitor. section 117 by the changeover switch 115. In the second 

Thus, in whichever mode the image taking device is image taking mode, it is transmitted to the second memory 
operated, it is possible to display the image output on a 132. 

monitor without any portion thereof being lost. Thus, in an In the first image taking mode, the image signal trans- 
image taking apparatus capable of image taking at high 60 mitted through the changeover switch 115 is conveyed to the 
resolution, it is always possible to check images on a first signal processing section 117, where it is subjected to 
monitor. Further, due to the compact and inexpensive addi- signal processing so as to be converted to luminance two- 
tional circuit, the apparatus of this embodiment is superior color difference signal (YUV). The first signal processing 
to the type of apparatus in which the high resolution images section 117 normally performs signal processing operations, 
are color-processed as they are, in that it makes it possible 65 such as color conversion, white balance, gamma conversion, 
to check the framing, exposure of taken images, focusing, aperture correction, and low-pass filtering to thereby convert 
etc. on the spot the signals transmitted through the color filter of the image 
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taking sensor 106 and optically stored into ordinary color digital signal processing. In the present invention, however, 
signals (RGB, YUV and the like). the processing in the first signal processing section 117 is not 
Generally speaking, to perform a processing operation restricted to digital processing. It is also possible to perform 
specific to each image taking sensor 106, a signalproccssing analog processing, performing digital processing after 
IC adapted to each particular image taking sensor 106 is 5 effecting A/D conversion at the time of input to the memory, 
provided. The signal converted to a luminance two-color P^^. 6 is a diagram showing a color filter arrangement in 
difference is input to the first memory 118. ^ taking sensor. BasicaUy, it has the same construe- 
Normally, the luminance two-color signal is suppHed to ^ ^^^t ^1^; 2. Tbe color filter jfi a <i^jnphmj}^,Ty _ 
the D/A converter 120 without being stored in the first ^^S^""^'!! u u llf Slu^m^ ^ (magenta). 
memon^nS and is converted to an analog si^^^ 10 ^STementary' gmosakS^ 

converter Then, it ^ encoded into a video signal by the SdTglferatW .il ^..^Ll l^J^i^A 

encoder 121 to be output as an output image signal 122, such arranged, and that the rows of ^een and magenta chang^ 

as a video signal or an S video signal. order for eachlin^ ' 

Further, when a switch (not shown) in a still picture taking In the first i^ge taking mode, the addition of two 

mode is depressed by using the operating switch 109, the 15 vertically adjacent pixels is effected in the ima p ,e takin g 

signal convened to a luminance two-color difference signal sensor 106 . A first field, which consists' of the first two lines 

by the first signal processing section 117 is stored in the first ~as counted from the first Hne, and a second field, which 

memory 118 controlled by the first memory control section consists of the first two lines as counted from the second 

119, and, while the image taking sensor 6 is operating in the Une^ are output as follows: 

second image taking mode, the image signal stored in the 20 Y^irsi Field 



first memory 118 is read and transmitted to the D/A con- fCy^ .+Gr, ^, Ye^ i+Mg^T Cya i+Gr^ i, Ye4 i+Mg4 . 
verter 120, and encoded by the encoder 121 before it is I p ^ y ^ U ^ ^ 

output as the video signal or S video signal 122. ^"^^ \ ■ M^r ' 



Cyi.7+Mgj,8, Ye2,7+Gr2.e, Cy3.7+Mg3.e, Ye4.7+Gr4.8, . 
Second Field 



Next, the operation in the second image taking mo de will 
be described. In the second imape faking morle. ^he''a?ntitinn 25 
of two vertically adjacent pjypl^ ^"^ r^nt rnrf j^cted in th e 
ima^e taking sensor 106. and a storage signal corresponding G^i.z+^yi.sj ^g2,2+Y*^2.3> ^h.2-^^3.3> ^g4.2+'^^4.3» • • * 

to the exposure amount of each pixel is independently ^§i.4+*^yi.5^ ^^z.4'^^^2.5> ^2>3A'^^y3.5> Gr4 4+Ye4 5, . . . 
output. In the second image taking mode, the incident-light GTi.g+Cyi.y, Mg2..6+^^2f* g+Cy3,7, Mg4.6+Ye4.7, . . . - 
is transmitted to the image taking sensor 106 by way of the 30 Mgi g+Cyj p, Gr2.8+Ye2.g, Mg3 g+Cyg g, Gr^ g+Ye4.g, . . . 
optical lens 101 and the aperture 102,-as in the first image As stated above, in the second image taking mode, the 
taking mode, and an optical image is formed thereon to image taking apparatus ot mis emooaimenl; docs rTot perform 
thereby effect image taking. The ima^e signal taken by the the addition of two vertically adjacent pixels in the image 
i mage taking sensor 106 is output m accoraancc with the taking sensor 106 is not conducted, and the optically stored 
tfm [pg prnv^deri hy the timing generator 35 signal of each pixel is output as it is. The total data is output 

The timing generator 112 drives the image taking sensor line by line through interlace output in the period of tw o 
106 by generating timing pulses which do not cause the fields, or separately in upper and lower h alves, 
additionof two vertically adjacentpixels to be performed in FIG. 7 is a flowchart illustrating ihe operation of the 

the image taking sensor. As in the first image taking mode, image taking apparatus of FIG. 5. As shown in FIG. 7, first, 
the image signal output fi'om the image taking sensor 106 is 40 in step PI, the image taking mode is set to the first image 
subjected to correlation double sampling and AGC by the taking mode, which is a moving picture taking mode, by the 
sample -and-hold/AGC circuit 113, and then digitized by the system controller 108, and the image taking sensor 106 is 
A/D converter 114.| ^^|ihsequentlv. the digitiz ed image sigija l operated in this image taking mode. 

h ¥i]pph'^^ tn Tn? f^p-fwiri ipp.mn rv 132 through I he Then, the image signal taken is subjected to signal pro- 

changeovef switch 115 and stored therein. 45 ccssing by the signal processing means 117, and supplied to 

,The image data stored in the memory p2 is independen t the D/A converter 120 without being stored in the first 
data tor each ot the pixels ot the image taking sensor,1 06. memory 118, Subsequently, in step P2, the image signal 
The independent image data is read by the system controller converted to an analog signal is encoded by the encoder 121, 
8, and subjected to computation to be thereby converted to and output as a video signal, thereby displaying the moving 
a color signal, which is stored in a high resolution storage 50 picture taken. 

device 134 and output to the exterior as needed. This Next, in step P3, a judgment is made as to whether the 

compulation processing also cionsists in signal processing operating switch 109 has been manipulated or not, and the 
operations, such as color conversion, white balance, gamma moving picture taking mode is maintained until the opera- 
conversion, aperture correction, and low-pass filtering to tion in a still picture taking mode is performed by the 
thereby convert the signals transmitted through the color ss operating switch 109. When the operating switch of the 
filter of the image taking sensor 106 and optically stored into second image taking mode, which is the still picture taking 
ordinary color signals (RGB, YUV and the like). mode, is depressed, the image being taken in the moving 

Further, the signal processing computation conducted picture taking mode is stored in the first memory 118 (step 
here consists in color processing for a so-called image P4), and, at the same time, read and displayed (step P5). 
processing and color processing for printing, and can be 60 As a result of the above operation, in the next step P6, the 
conducted as a separate processing which has not been display is changed from the moving image which has been 
optimized in order to be displayed on a monitor as in the case taken by the image taking sensor 106 to the still image stored 
of the first signal processing section 117. in the first memory 118. After this, the image taking mode 

As shown in FIG. 5, in the case of the image taking is switched to the still picture taking mode, that is, the 
apparatus of this embodiment, the first signal processing 65 second image taking mode. 

section 117 is arranged on the output side of the A/D In the second image taking mode, the image taking sensor 
converter 114 and the changeover switch 115 and effects 106 operates in the still picture taking mode, and the 
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changeover switch 115 is switched to the side where the amount of movement d of the optical image can be easily 

input image signal is transmitted to the second memory 132. obtained from the angle of rotation 9 of the plane parallel 

The image signal taken by the image taking sensor 106 in plate 104. 
this still picture taking mode is stored in the second memory 

132 as independent data on each pixel (step P7). $ - -1/7/ M\ 

Then, the image data stored in the second memory 132 is 9= an |7|l - - j| 
read by the system controller 8 and subjected to computation 
processing to be thereby converted to luminance two-color 

difference data or RGB data (step P8). Here, the signal In FIG. 8, the operation in the first image taking mode is 

processing computation is advantageous when separately the same as that in the first embodiment. Int|ifi .Sfi^p^^ iip a^e 

performing color processing for a so-called image J^Wmfr mode, the \v^^^e. taking sensor lOrnerfnrms no pixel 

processing, or color processing for printing, that is, a pro- addition, but the optical storage data of each pixel is output, 

cessing that is not a signal processing optimized for the Further, the storage in the second memory 132 is repeated a 

purpose of monitor display as in the case of first signal pluraUly of times while controlling the plane parallel plate 

processing section 117, for example, a processing for real- 1^ '^y ^^e control means 105. 

izing an enhanced resolution. By the above operation, image signals are taken in while 

In this embodiment, the second signal processing section effecting pbcel shift, and the image signals thus taken in are 

is formed by a software based on the system controller 108 subjected to computation processing, such as color 

to perform a processing as mentioned above. However, it is processing, whereby a high-resolution image can be 

also possible to realize the above signal processing section obtained. Actually, the movement of the plane parallel plate 

in the form of a hardware. 20 104 is controlled such that the optical image on the plane 

FIG. 8 shows the fifth embodiment of the present inven- parallel plate 104 moves one pixel to the left, one pixel 

tion. In FIG. 8, numeral 104 indicates a rotatable plane downwards, and one pixel to the right, the image signal 

parallel plate for moving the optical axis; and numeral 105 obtained by image taking in each position being stored in the 

indicates control means for controlling the rotatable plane second memory 132. 

parallel plate 104. Apart from the above, the image taking 25 In this way, the optical image is moved one pixel at one 
apparatus of this embodiment has the same construction as time, and stored in the memory at each position, whereby 
that shown in FIG. 5. filter data of the four colors (Cy, Ye, Mg and Gr) is stored 
In the image taking apparatus of FIG. 8, the rotatable in the second memory 132. Due to this arrangement, four- 
plane parallel plate 104 is arranged between the group -color data exists in each pixel, so that computation process- 
consisting of lens 101 and the aperture 102 and the image 30 ing is possible for each pixel, thereby making it possible to 
taking sensor 106. This rotatable plane parallel plate 104 is enhance the resolution as compared with that of a single - 
rotated around two axes perpendicular to the optical axis. plate color sensor. 

This makes it possible to move the optical image formed 00 Next, an image taking example when the pixel shift is 

the image taldng sensor 106. By controlling the angle of effected while moving the plane parallel plate 104 will be 

rotation of the rotatable plane parallel plate 104 by the 35 described with reference to FIG. 10. FIG. 10(a) shows an 

control means 105, it is possible to move the optical image image taking using a complementary color mosaic filter, 

formed on the image taking sensor 106 by a desired move- First, image data taken in this condition is stored in the 

ment amount. second memory 132. FIG. 10(b) shows the condition in 

FIG. 9 is a diagram showing that an optical image is which the plane parallel plate 104 is rotated from the 

moved by rotating the plane parallel plate around an axis 40 position of FIG, 10(a) so as to shift the image one pixel to 

parallel to the optical axis. Symbol 0 indicates the angle of the left. The broken line indicates the range of the moved 

rotation of the plane parallel plate 104, and symbol d optical image. 

indicates the movement amount of the optical image. The FIG. 10(c) shows the condition in which the plane parallel 

movement amount d of the optical image is a function of the plate 104 is rotated from the position of FIG. 10(b) so as to 

refractive index n, thickness T, and angle of rotation 0 of the 45 shift the image one pixel upwards. FIG. 10(d) shows the 

plane parallel plate 104. condition in which the plane parallel plate 104 is rotated 

When a particular plane parallel plate 104 is selected, the from the position of FIG. 10(c) so as to shift the image one 

refractive index n and the thickness T are uniquely deter- pixel to the right. Through these four positions, it is possible 

mined. Thus, the movement amount d of the optical image to store four kinds of image data obtained by moving the 

is a function of the angle of rotation 0 only, as expressed by 50 optical image upwards, downwards, to the right and to the 

the folbwing equation: left, one pixel at one time. 

FIG. 11 is a flowchart for illustrating the operation of an 

rf = (0, n. T) (1) image taking apparatus according to the fifth embodiment. 

In FIG. 11, finst, in step PI, the operation mode is set to 

(2) 55 the moving picture taking mode (that is, the first image 
taking mode), and the image taking sensor 106 is operated 
in this image taking mode. 

The image signal taken is then subjected to signal pro- 

When the value of 6 is small, the foUowing approximation 'tlf^f'^' ^g°f' ^1°"^^^ ^l' """.'"P- 

. , , , & rr pijg^ Y)f^ converter 120, without being stored in he 

° ^ first memory 118, thereby converting the image signal to an 

J ^ analog signal. The image signal thus converted to an analog 

i/i6=7|J--jsme signal is then supplied to the encoder 121 and encoded 

" ^ before it is displayed as a video signal (step P2). 

65 Next, the procedure advances to step P3, where a judg- 

In expression (3), when the value of 0 is small, linear ment is made as to the still picUire mode has been set through 

approximation of sin 0 is substantially possible, whereby the key operation or not, and this image taking mode is main- 



cosfl 

d - Tsinfit 1 
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tained until the operation mode is set to the still picture 
taking mode by using the operating switch 109. 

When the still picture taking mode (the second image 
taking mode) switch is depressed, the image which has been 
taken in the moving picture taking mode is stored in the first 
memory 118 (step P4), which is read out for display (step 
P5). Next, in step P6, the display is switched from the image 
taken by the image taking sensor 106 to the image stored in 
the first memory 118, and then the moving picture taking 
mode is switched to the still picture taking mode (that is, the 
second image taking mode). 

In the still picture taking mode, the image taking sensor 
106 operates in the still picture taking mode, and the 
changeover switch 115 is switched to the position in whicb 
the image signal is transmitted to the second memory 132. 
The image signal taken by the image taking sensor 106 in the 
still picture taking mode is stored in the second memory 132 
as independent data on each pixel (step P7). 

Subsequently, the procedure advances to step P8, in which 
the plane parallel plate 104 is rotated under the control of the 
control means 105 so as to shift the optical image formed on 
the image taking sensor 106 one pixel to the left to attain the 
condition of FIG. 10(b), which is stored in the second 
memory 132. 

Similarly, in the next step, P9, the optical image is shifted 
one pixel upwards to attain the condition of FIG. 10(c), 
which is stored in the second memory 132. Similarly, the 
optical image is shifted one pixel to the right to attain the 
condition of FIG, -10(c^), which is- stored in the second 
memory 132 (step PIO). Finally, the optical image is shifted 
one pixel downwards to restore the optical image to the 
original position (step Pll). 

In this way, the plane parallel plate 104 is used to take in 
image data four times, while shifting the image one pixel at 
one time. By using the image data thus taken in four times, 
the system controller 108 reads the data and performs 
computation processing to convert the data to luminance 
two-color difference data or RGB data. 

Unlike the signal processing conducted when forming a 
color image with a single plate sensor, the signal processing 
computation conducted here enables a color image signal to 
be formed through a simple matrix computation since every 
pixel is provided with four color (Cy, Mg, Ye and Gr) data. 
Thus, it is possible to form an image signal of a higher 
resolution as compared to the image signal obtained by the 
single place sensor. 

While in this example the second signal processing sec- 
tion is formed by a software based on the system controller 
108, it is also possible for the second signal processing 
section to be realized in the form of a hardware. 

Further, while in the fifth embodiment the pixel shift is 
conducted by using the plane parallel plate 104, a similar 
pixel shift is also possible by lens shift (in which one or a 
plurahty of lenses of a plurality of lenses are shifted per- 
pendicularly with respect to the optical axis), or by using a 
variable-apex-angle prism. 

Further, while in the fifth embodiment one-pixel shift is 
effected four times to thereby enhance resolution, it is also 
possible to attain a further enhancement of resolution by 
effecting H pixel shift four times both vertically and 
horizontally, i.e., sixteen times in total. 

Next, an image taking apparatus according to a sixth 
embodiment of the present invention will be described. FIG. 
12 is a schematic diagram showing an image taking appa- 
ratus according the sixth embodiment. According to the 
sixth embodiment, the image taking apparatus is divided 
into a camera head section and a camera signal processing 
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section, thereby making it possible to selectively connect a 
plurality of camera head sections. 

In FIG. 12, numeral 1101 indicates a first camera head 
section; numeral 1102 indicates a second camera head 

S section; and numeral 1103 indicates a third camera head 
section. Numeral 1110 indicates a camera signal processing 
section; numeral 1111 indicates a host computer; numeral 
1112 indicates a monitor for display; numerals 1121, 1122 
and 1123 indicate signal cables for connecting the camera 

10 head sections to the signal processing section; numeral 1125 
indicates a signal cable for connecting the host computer to 
the camera signal processing section; and numeral 1126 
indicates a video cable. 

FIGS. 13 and 14 are block diagrams showing camera head 

15 sections. FIG. 15 is a block diagram of the camera signal 
processing section. The camera head section of FIG. 13 is a 
camera head in which no pixel shift is effected, the camera 
head section of FIG. 14 is a camera head in which pixel shift 
is effected to thereby attain an enhanced resolution. In FIGS. 

20 13, 14 and 15, numeral 140 indicates an ampUfier; numeral 

141 indicates an image signal transmission line; numeral 

142 indicates a signal line for transmitting a synchronous 
signal generated by the synchronous signal generator 107; 
numeral 143 indicates a control unit (MPU) for controlling 

25 the operation of the camera head sections; and numeral 144 
is a signal line for connecting between the control unit 143 
and the camera system controller 145. 

In the sixth embodiment, the camera head and the signal 
processing section-are separated from each other, so that it 

30 is possible to freely combine a plurality of kinds of camera 
heads. Thus, through combinations of the camera heads and 
the signal processing section, it is possible to construct, for 
example, an image taking system in which only one image 
taking mode is supported, or an image taking system in 

35 which high resolution image taking is possible. 

As described above, in accordance with the present 
invention, a plurality of moving picture taking modes are 
provided for the image taking sensor, and, at the same time, 
at least two kinds of signal processing sections are provided 

40 in correspondence with the above-mentioned plurality of 
moving picture taking modes to perform signal processing 
separately in each of these moving picture taking modes, so 
that it is possible to satisfactorily conduct the signal pro- 
cessing for monitor display and other image signal process- 

45 ing operations. 

Further, an optical axis moving means is provided, by 
means of which the respective signals of the pixels of the 
image taking sensor can be independently extracted, thereby 
making it possible to perform image taking at high resolu- 

50 tion. 

Further, by separating the camera head and the signal 
processing section from each other, it is possible to freely 
combine a plurality of types of camera heads, and, through 
appropriate combination of these camera heads, it is possible 

55 to reahze, for example, an image taking system in which 
only one image taking mode is supported, or an image taking 
system that is capable of image taking at high resolution. 

Further, regarding the optical axis moving means, it can 
be realized without involving an increase in the size of the 

60 optical system in the case of the lens shifting method. In the 
case of the method using a variable-apex-angle prism, it is 
possible to move the optical axis to a great degree. In the 
case of the method in which the plane parallel plate is 
rotated, it is possible to effect fine changes relatively easily. 

65 FIG. 16 is a block diagram of the seventh embodiment of 
the present invention. In the drawing, the components which 
are the same as those of FIGS. 1 through 15 are indicated by 
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the same reference numerals. Numeral 3 indicates a shutter, 
and numeral 215 indicates a first memory. 

Next, the operation of this embodiment will be described. 
In FIG. 16, when the shutter 12 is opened, the sensor 10 is 
exposed, and, in accordance with the synchronous signal s 
generated by the first synchronous signal generator 7, driv- 
ing pulses for the sensor 10 are generated by the timing 
generator 12, and the electric charge stored in the sensor 10 
is read out. The SH,AGC circuit 13 eliminates switching 
noise from the high resolution signal read out by the sensor lO 
10. After sample-and-hold and AGC for extracting the signal 
component, the image signal is converted to digital data by 
the 10-bit AyD converter 14. 

The image data converted to digital data by the A/D 
converter 14 is stored in a first memory 215 under the 15 
control of the first memory controller 16. Here, die image 
signal read from the sensor 10 is stored as it is in the first 
memory 215. After this, in the first color processing section 
17, color conversion is effected to convert the data to 
luminance two-color difference (YUV) data, which is stored 20 
in the second memory 18 for YUV. 

When reading data stored in the first memory 215 and 
subjecting it to color processing, a color processing circuit 
for video cannot be used, and it is necessary to conduct color 
conversion with software or provide a dedicated computa- 25 
tion circuit like DSP. Thus, in reality, this stage take a lot of 
time. The image signal converted to luminance two -color 
difference (YUV) data is compressed by the compression/ 
expansion section 20 as needed before it is suppUed to the 
file of the storage device 22 through the interface 21. When 30 
the data read firom the file is compressed data, it is expanded 
by the compression/expansion section 20. 

Next, when previewing the image taken by the sensor 10, 
the image data stored in the first memory 215 is read under 
the control of the first memory controller 16 in accordance 35 
with the synchronous signal generated by the ordinary 
synchronous signal generator for television 8, and input to 
the second color processing section 31. Here, the image of 
1536x988 pixels is compressed to and read as an image 
of 768x494 pixels. By thus reducing the number of pixels to 40 
768x494, the same condition as in the case of a CCD sensor 
that is widely used in ordinary television sets is obtained. 

This reduction can be effected in various ways, such as 
thinning-out by haff, a reduction in information amount by 
performing averaging with respect to each filter, a reduction 45 
by interpolation, or by simply reading exclusively the area 
corresponding to Vi, 

Since the input signal of the second color processing 
section 31 is obtained by reading image data stored in the 
first memory 15 in synchronization with an ordinary syn- 50 
chronous signal for television, it is possible to use a color 
conversion circuit widely used in video cameras, etc. for this 
color processing section. Therefore, the processing in this 
section can be performed in a short time. The image signal 
converted to luminance two-color difference (YUV) data by 55 
the second color processing section 31 is converted to an 
analog signal by the D/A converter 32, and modulated into 
a video signal for an ordinary television system by the 
encoder 33 before it is output as the video signal 34 and 
displayed on a video monitor (not shown). 60 

FIG. 17 is a block diagram showing the construction of 
the first memory 215 and that of the first memory controller 
16 in detail. 

In FIG. 17, numeral 241 indicates digital image data 
obtained by conversion at the A/D converter 14; numeral 65 
242 indicates an input buffer to the first memory 215; 
numeral 243 indicates a memory section of the first memory 
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215; numeral 44 indicates a first output buffer of the memory 
section 243; numeral 45 indicates an output signal from the 
memory section 243 to the first color processing section 17 
of FIG. 16; numeral 46 indicates a second output buffer of 
the memory section 243; and numeral 47 indicates an output 
signal from the memory 243 to the second color processing 
section 31. 

Numeral 48 indicates an address mulitplcxer for the 
memory section 243; numeral 49 indicates a write address 
generator for generating an address signal for storing image 
data in the memory section 243 in accordance with the 
synchronous signal generated by the first synchronous signal 
generator 7; and numeral 50 indicates a read address gen- 
erator for generating an address for reading image data from 
the memory section 243 in accordance with the synchronous 
signal generated by the second synchronous signal generator 
8. 

Numeral 51 indicates a read/write address generator for 
generating a read/write address for conducting color pro- 
cessing in the first color processing section 17 and reading 
and writing image data of the memory section 243 through 
the interface 21; numeral 52 indicates a memory access 
arbitrator for avoiding conflict in access in the memory 
section 243; and numeral 53 indicates a request signal for 
reading/writing image data of the memory section 243 
through the interface 21 in order to perform color processing 
in the first color processing section 17. 

Next, the operation of this embodiment will be described. 
In FIG. 17, the image taken by opening the shutter is 
A/D -converted in accordance with the synchronous signal 
generated by the first synchronous signal generator 7, and 
the image data 241 is input to the memory section 243 
through the input buffer 242 of the memory 215, At the same 
time, a write address for writing into the memory section 
243 is generated by the write address generator 49 in 
accordance with the synchronous signal generated by the 
first synchronous signal generator 7, and image data trans- 
mitted through the input buffer 42 is stored in a predeter- 
mined address in the memory section 243. 

The image data stored in the memory section 243 is read 
from the memory section 243 in accordance with the syn- 
chronous signal generated by the second synchronous signal 
generator 8 and in accordance with the address generated by 
the read address generator 50. In this process, a number of 
pixels corresponding to in the X and Y-directions of the 
stored image data are read out. 

The thinning-out to ¥i can be effected, for example, by a 
method according to which the two address counters of X 
and Y are incremented by two at one time, or a method 
according to which the two address counters of X and Y 
count in the normal manner, and the data obtained is shifted 
by 1 bit (doubled) before it is supplied to the memory section 
243. In another method for reduction, a reduction can be 
effected through computation instead of by thinning out. 
When exclusively an area corresponding to V4 is simply read, 
a start address for specifying the area to be read out is 
provided, and the X and Y-address counting is conducted 
with the start address as offset, thereby making it possible to 
read a area. 

By reading image data stored in the memory section 243 
in accordance with the address generated by the read address 
generator 50, the unage data is transferred to the second 
color processing section 31 through the second output buffer 
46, whereby, as described with reference to FIG. 16, the data 
is output through the second color processing section 31, the 
D/A converter 32 and the encoder 33 as the video signal 34, 
thereby making it possible to check the taken image on a 
video monitor. 
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When the framing, etc. of the taken image has been 
checked in this way through the television monitor, the 
image data stored in the memory 243 is read out in accor- 
dance with the address generated by the write/read address 
generator 51, and subjected to color conversion by the first 
color processing section 17 through the first output bufifer 
44. Here, the memory access arbitrator 52 serves to perform 
arbitration between the three access requests from the first 
synchronous signal generator 7 during image taking, the 
second synchronous signal generator 8 for video output, and 
the request signal 53 for the operation of the first color 
processing section 17. 

The second synchronous signal generator 8 for video 
output constantly generates an access request to constantly 
supply data to the video monitor. However, the access 
request from the first synchronous signal generator 7 during 
image taking and the request signal 53 for the processing in 
the first color processing section 17 are generated only once, 
that is, during image taking and color processing, 
respectively, so that no conflict in access occurs between 
them. Thus, it is only necessary to perform arbitration 
between the access by the second synchronotis signal gen- 
erator 8 and the other accesses. This arbitration can be easily 
effected by a well-known method, such as cycle stealing 
using a high-speed memory device. 

FIG. 18 shows the eighth embodiment of the present 
invention. In the drawing, numeral 35 indicates a third 
memory; numeral 36 indicates a third memory controller for 
controlling the third memory 35; and numeral 37 indicates 
a third color processing section for performing color pro- 
cessing. The third color processing section 37 has first and 
second color processing modes respectively corresponding 
to the first and second color processing sections 17 and 31, 
so that it is capable of color processing in both modes. This 
can be realized on a software basis by using a computation 
processor, such as DSP. 

As m the case of FIG. 16, when the shutter 2 is opened, 
the sensor 10 is exposed, and driving pulses for the sensor 
10 are generated by the timing generator 12 in accordance 
with the synchronous signal generated by the first synchro- 
nous signal generator 12. Then, the electric charge accumu- 
lated in the sensor 10 is read out, and subjected to sample - 
and-hold and AGC by the SH.AGC circuit 13 for removal of 
switching noise and extraction of signal component. The 
data thus obtained is converted to digital data by the 10-bit 
A/D converter 14, and stored in the first memory 215 under 
the control of the first memory controller 16. Here, the image 
data read out from the sensor 10 is stored in the first memory 
215 as it is. 

The image data stored in the first memory 215 is read as 
image data with its amount reduced to H both vertically and 
horizontally in accordance with the synchronous signal 
generated by the second synchronous signal generator 8, and 
subjected to color processing in the second color processing 
mode by the third color processing section 37 to the con- 
verted to luminance two-color difference (YUV) data before 
it is stored in the third memory 35. The luminance two-color 
difference (YUV) data stored in the third memory 35 is read 
by the third memory controller 36 in accordance with the 
synchronous signal generated by the second synchronous 
signal generator 8, and converted to an analog signal by the 
D/A converter 32. After this, it is modulated by the encoder 
33 and output as the video signal 34 before it is displayed on 
a video monitor (not shown). 

Next, all the image data is read out from the first memory 
215, and subjected to color conversion in the first color 
processing mode by the third color processing section 37 to 
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be converted to luminance two-color difference (YUV) data, 
which is stored in the second memory 18 for YUV. The 
image data converted to luminance two-color difference 
(YUV) data is compressed by the compression/expansion 

5 section 20 as needed, and converted into the file of the 
storage device 22 through the interface 21. 

FIG. 19 shows the ninth embodiment of the present 
invention. In FIG. 19, no shutter is placed in front of the 
sensor 10, and the first synchronous signal generator 7 is 

10 constantly operating, with the sensor 10 constantly perform- 
ing image taking. However, since the number of pixels of the 
sensor 10 is large, the image signal taken cannot be read at 
such a speed as in the case of ordinary NTSC or PAL video 
signals. It is read at a rate of approximately 15 frames per 

15 second. As in the case of he image signal read from the 
sensor 10 is transmitted by way of the SH AGC circuit 13 
and the 10-bit A/D converter 14, and stored in the first 
memory 215. In this case, data is read from the sensor 10 
constantly and continuously, so that the first memory 215 is 

20 constantly updated with new image data. 

The high resolution image stored in the first memory 215 
and updated is read out, with the number of pixels reduced 
to 768x988, in accordance with the synchronous signal 
generated by the second synchronous signal generator 8, that 

25 is, the synchronous signal of an ordinary synchronous signal 
generator for television. The image data read out from the 
first memory 215 in synchronization with the synchronous 
signal of the second synchronous signal generator 8 is 

—color-converted by the-second color processing- section 31, 

30 and transmitted by way of the D/A converter 32 and the 
video signal encoder 33 before it is output as the video signal 
34. 

Further, the image signal constantly taken by the sensor 
10 is monitored by a video monitor (not shown) to which the 

35 above video signal 34 is supplied, and, at the same time, 
triggering is effected when necessary by manual operation 
(not shown) or the like to read the image data stored in the 
first memory 215 to convert it into the file or output it 
through the interface 21 as digital data to perform 

40 processing, such as color processing, in the exterior. 

In still another embodiment, a number of taken images are 
stored in the file of the storage device 22 in FIGS. 16 and 19, 
and, prior to reproducing the images, they are temporarily 
stored in memory. This data is read in accordance with the 

45 second synchronous signal generator 8, and subjected to 
color processing by the second color processing section, 
whereby the checking and retrieval of the images filed by the 
images due to the output video signal 34 can be performed 
easily and quickly. 

50 In accordance with the present invention, the image 
taking device is driven by the synchronous signal of the first 
synchronous signal generator, and the image signal thereby 
obtained is A/D-converted and temporarily stored in the 
memory. The image signal thus stored is read by the syn- 

55 chronous signal of the first synchronous signal generator and 
color-converted by the first color processing section. On the 
other hand, the memory is read with the synchronous signal 
of the second synchronous signal generator. Thus, even in 
the case of an image taking device consisting of a high- 

60 resolution sensor, it is possible to check an image immedi- 
ately by a video monitor. Further, as compared to the case in 
which the high-resolution image is subjected to color pro- 
cessing as it is, the present invention is advantageous in that, 
due to the addition of a compact and inexpensive circuit, it 

65 is possible to immediately check the framing, the exposure 
of the taken image, focusing, etc. Further, when reproducing 
a number of taken images stored in a file, the filed image can 
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be checked, retrieved, etc, easily and instantly by using a 
video monitor before this file is read out and subjected color 
processing to be reconstructed as a picture. 
What is claimed is: 

1. An image sensing apparatus comprising: 
optical-axis deflecting means for deflecting an optical axis 

of an optical system; 
image sensing means for converting an image formed by 

the optical system on an image sensing plane to an 

image signal; 

first signal processing means for performing a first pre- 
determined signal processing on the image signal out- 
put from said image sensing means, the first predeter- 
mined signal processing including storing the image 
signal in a first memory; 

second signal processing means for causing said optical- 
axis deflecting means to deflect the optical axis to a 
plurality of positions and for performing a second 
predetermined signal processing for combining the 
image signals on the image signals output from said 
image sensing means corresponding to a plurality of 
deflected positions of said optical-axis deflecting 
means, the second predetermined signal processing 
including storing the combined image signals in a 
second memory; 

mode selecting means for selecting a first signal process- 
ing mode causing said first signal processing means to 
^perform the first predetermined signal processing and a 
second signal processing mode causing said second 
signal processing means to perform the second prede- 
termined signal processing; and 

control means, in the second signal processing mode, for 
causing said second signal processing means to per- 
form the second predetermined signal processing and 
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outputting an image signal output from said first 
memory of said first signal processing means during 
performing of the second predetermined signal pro- 
cessing by said second signal processing means using 
said second memory. 

2. An image sensing apparanis according to claim 1, 
wherein, in the first signal processing mode, said image 
sensing means reads image signals corresponding to two 
verticaUy adjacent lines and outputs a signal obtained by 
adding image signals corresponding to two vertically adja- 
cent pixels, and, in the second signal processing mode, said 
image sensing means outputs a signal for each pixel, without 
performing addition of image signals. 

3. An image sensing apparatus according to one of claims 
1 and 2, wherein said image sensing means comprises an 
image sensing device and a complementary color mosaic 
filter. 

4. An image sensing apparatus according to one of claims 
1 or 2, wherein said image sensing means comprises a CCD. 

5. An image sensing apparatus according to one of claims 
1 or 2, wherein said optical-axis deflecting means comprises 
a variable -apex-angle prism. 

6. An image sensing apparatus according to one of claims 
1 or 2, wherein said optical-axis deflecting means comprises 
means for shifting a lens. 

7. An image sensing apparatus according to one of claims 
1 or 2, wherein said optical-axis deflecting means comprises 
a parallel-plate rotating system. 

8. An image sensing apparatus according to claim 1, 
wherein the optical system and said image sensing means 
are selectively separable from said first and second signal 
processing means while being connectable together through 
a cable. 
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